AD-A054  937 


UNCLASSIFIED 


DEFENCE  RESEARCH  ESTABLISHMENT  PACIFIC  VICTORIA  (BRIT--ETC  F/G  12/1 
THE  ASYMPTOTIC  RELATIVE  EFFICIENCY  OF  VARIOUS  NONPARAMETRIC  DET— ETC(U) 
DEC  77  M J MlLMUTr  R F MACKINNON 


N. 


DREP-TM-77-13 


NL 


I' 


NTIS  RiPftOOtfCtlON 
iY  NRMISItOll  Of 
IMfORMATION  CANADA 


Vittoria,  B.C. 


Tachnicol  Memorandum  77*13 


THE  ASYMPTOTIC  RELATIVE  EFFICIENCY  OF  VARIOUS 
NONF^RAMETRIC  DETECTORS  USED  ON  SPECTRAL  DAT 


M.U.Wilmut  and  R.  F.  MocKinnon 


December  1977 


eeerch  end  Development  Branch 
Department  of  National  Defence 


UNCLASSIFIED 
UNLIMITED  DISTRIBUTION 


Defence  Research  EsTABLiSHMEfir  Pacific 
VICTORIA/  B.C. 


This  information  is  fumishsd  uith  ths  sxprsss 
undsrstanding  that  propristary  and  patsnt  rights 
htill  bs  protsatsd. 


Technical  Memorandum  77-13 


^E  ^YMPTOTIC^LATIVE  J^FFICIENCY  OF  ^RIOUS 

tonpXrametric  Detectors  Used  on  spectral  data  # 


(SO) I 

/ irr\-tynOt^ 


i 


Approved  for  distribution 


Research  and  Development  Branch 
Department  of  National  Defence 
Canada 

m iw 


UNCLASSIFIED 
UNLIMITED  DISTRIBUTION 


ABSTRACT 

Asymptotic  relative  efficiency  (ARE)  and  asymptotic  loss  are  two 
ways  to  compare  the  performance  of  one  detector  to  another  and  in  particular 
to  the  optimum  detector. 

Various  authors  have  suggested  and  studied  a variety  of  nonpara- 
metric  detection  schemes  applicable  in  the  analysis  of  spectral  data.  Here 
we  derive  theARE'sof  the  modified  Savage  detector  and  Sc  set  of  detectors. 

It  is  shown  that  in  most  cases  of  practical  interest  the  ARE  of  the  modified 
Savage  detector  is  higher  than  that  of  the  Mann-Vfhltney  detector.  The  asymp- 
totic loss  of  the  modified  Savage  detector  with  respect  to  the  optimum  detec- 
tor in  these  cases  is  less  than  1 dB. 
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INTRODUCTION 

We  consider  the  situation  (References  (l)  to  (4))  In  which  a signal 
embedded  In  a time  series  appears  as  a narrow  line  In  the  frequency  domain. 
Detection  Is  based  on  the  matrix  of  the  spectral  estimates  j • 1*1, 2, ...M; 
j“l,2,...,N.  Here  time  Is  referenced  by  the  1 parameter  and  frequency  by  the 
j parameter.  The  parameter  N Is  the  largest  numbpr  of  frequency  estimates 
for  which  the  spectrum  can  be  said  to  be  flat,  while  M is  the  number  of  spec- 
tral estimates  per  frequency  cell  to  be  used  in  the  decision  process. 

Let  R . . be  the  rank  of  the  X..  for  a fixed  time  Interval:  that  Is 
ij  ij 

1 fixed,  j*l,2,...,N.  The  null  hypothesis  is  that  all  N frequencies  contain 
noise  only.  For  the  Independent  Identically  distributed  random  variables, 
the  R^j  are  uniformly  distributed  over  the  integers  1,2,...N.  The  alternative 
hypothesis  is  that  a signal  occurs  at  one  of  the  frequencies  represented.  In 
order  to  determine  the  distribution  of  the  ranks  in  this  case,  one  must  assume 
a specific  distribution  for  the  ; that  is,  one  must  specify  the  nature  of 
the  signal  and  the  noise. 

Let  P(k)“P(k,N,6)  be  the  probability  that  the  signal  frequency  takes 
rank  k where  k*l,2,...N.  The  parameter  9 is  the  signal-to-noise  ratio.  In  (2] 
and  (4  ) it  is  shown  that: 

ar(N)  r (N+g-k) 


P(k)-P(k,N,a)= 


r (N+a) r (N-k+1) 


(la) 


where  a represents  -r-^  when  the  signal  is  narrow-band  with  a gausslan  ampli- 
tude  distribution  (also  called  a Rayleigh  Fading  signal). 


r (N-k+l) 


i-0 


(N+l-k+i)r(i+l)r(k-i) 


(lb) 
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when  the  signal  Is  a sinusoid  (also  called  a no  fading  signal). 


Pm-Pfk  N a b)-  ° 

^(k)  P(k,N,a,b)  ^(N+b) r(N-k+l) 


k-1 

l+2a  Z 

i-0 


(i+N+b-k) 


where  a is  equal  to  (2+4/9)  ^ and  b is  equal  to  (1+  •^)  This  probability 

function  results  when  we  have  a narrowband  signal  with  a fluctuating  amplitude 

(also  referred  to  as  a Swerling  case  4 signal) . The  standard  deviation  divided 

by  the  mean  is  a measure  of  fluctuation  of  a signal.  This  quantity  is  1,  0 and 
-h 

(2)  respectively  for  the  above  signal  spectral  estimates. 


Detector 


The  modified  nonparametrlc  decision  schemes  discussed  below  are 


based  on  the  sum  of  M Independent  random  variables  representing  some  function 

of  the  rank  at  each  frequency.  That  is,  we  decide  that  a signal  is  present 

at  frequency  j depending  on  the  value  of 
M 

W » E a(R^J 


where  a (x)  is  some  function  of  x. 

Suggested  forms  for  a (x)  Include: 

(1)  Mann-Whitney  statistic). 

” -1 

(ii)  a(R  )=  Z SL  (modified  Savage  test). 

^ )l=N-R^j+l 

(ill)  a(R^j)=slgn(R^j-c)  (Sc  detector).  Here  c is  any 
integer  from  1 to  N.  In  other  words  we  set  the 


ACCESSION  Tof 

[kT6 
I DOC 

I UNANHOUNC':^ 
1 JUSTIflCATlC- 


v;  :'e  ® largest  c spectral  estimates  to  one;  all  other 

c .V,  ion  □ 

Q estimates  are  given  the  value  zero. 


~55r  '■■1^  . 
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Asymptotic  Relative  Efficiency 


’■a  E(w|0) 

- 

30 

tir>i  1 

1- 

0-0-^ 

M 


(2) 


where  o^  (W)  Is  the  va•.•!'^^ce  of  the  test  statistic  W In  the  noise  only  case 
and  E(w|0)  the  expected  value  of  W when  the  signal-to-nolse  ratio  is  6. 

To  compare  two  detectors  A and  B,  we  form  the  ratio  of  their  effi- 
ciencies S,A-®B/e^  and  this  is  then  the  asymptotic  relative  efficiency  of 
detector  B with  respect  to  detector  A.  The  ARE  is  a measure  of  the  performance 
of  one  detector  with  respect  to  another  when  a large  number  of  observations 
are  available  for  processing  and  the  signal- to-nolse  ratio  is  small.  Even 
when  a small  number  of  observations  are  available  the  ARE  in  many  situations 
of  practical  Interest  is  a good  measure  of  the  relative  efficiencies  of  the 
detectors  being  studied  (s)  . 

The  asymptotic  loss  of  detector  A compared  to  detector  B is  given 

by  (2) 


L = 

CO 


&im 

M-x® 


S/Pd.Pf.M) 
A 

Sg(Pd,Pf,M) 


where  S^(Pd,Pf,M)  is  the  slgnal-to-noise  ratio  required  by  detector  A to  yield 
specified  values  of  Pd (probability  of  detection)  and  Pf (false  alarm  probability) 
for  a given  number  of  observations  M.  In  other  words,  it  is  the  asymptotic 
degradation  of  slgnal-to-nolse  ratio  when  one  uses  one  detector  as  compared  to 
using  another  (when  both  must  meet  the  same  performance  criteria  and  the  number 
of  observations  available  is  large) . 

The  ARE  and  asymptotic  loss  in  our  problem  are  related  by 

-1/2 

L >•£  or  in  decibels  L * -5  log.  ^E. 
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ASYMPTOTIC  RELATIVE  EFFICIENCY  WHEN  SIGNAL  GAUSSIAN 
In  the  following  we  determine  the  quantities  a ^(W)  and  -Is" 

O do 

(Ignoring  the  subscript  j)  In  order  to  obtain  the  efficiencies  (EquatlonC 2)) 
and  hence  AREs  of  the  test  statistics  noted  above.  We  assume  that  the  signal 
Is  gausslan. 

Modified  Savage  Detector 

Let  S In  this  section  denote  the  modified  Savage  random  variable 

N .1  2 

i(R. .)“  Z 1 . We  will  determine  o (S)  and  E(S|6)and  as  W Is  the 

<,=N-R^j+1  ° 


2 2 

stjm  of  M such  Independent  random  variables  (W)*Ma^  (S)  and  E(Wle)=ME(S |e) . 
We  now  state  and  prove  two  propositions  needed  to  determine  the  ARE  of  the 
Savage  detector. 

Proposition  1;  The  expected  value  of  the  statistic  S for  a given  value  of  0 
Is  given  by 


E(sle)- 


11  r(a)r(N) 
No  r (N+a) 


where  a = 


1+0 


N 

To  determine  E(S|0)  we  must  evaluate  Z 6.  P(k,N,a)  where 
N k=l 

^ ^ Is  the  weighting  for  the  Savage  statistic  and  P(k,N,a)  Is  from 

M=N-k+l“ 

Equation  (la).  Let 


N 

Z 


k-1 


N / N 1 \ 

Z ( Z M )- 

n=l  \M=N-k+l/ 


^ \ar(N)r(N+a-k) 


r(N4«)r(N-k+i) 


1 r(N)r(N+a-l) 


N r(N+a)r(N) 


N / N 1 \ 
Z ( Z M ) 
k-2  \M«N-k+l/ 


ar(N)r(N+a-k) 

r(N+a)r(N-l+l) 


N(N+a-l) 


” ^ \ar(N)r(N+q-k) 

/ r(N+a)r(N-k+i) 


N 

Z 


ar(N)r(tH-a-k) 

r(N+a)r(N-k+l) 
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N(N+c»-l) 


M •*•  -5  ^ (N-l)r(N-l)r(N+a-k-l) 

k-1  \ M-N-k  / r (N+ci-l)  r (N-k)  N (N+a-l)r(N4<x-l)r(N-k) 


= _a . N-1  ^ , 1 + ■(N-.l)  T , . 

^ N(N+a-l)  N+a-1  N-1  N(N+a-l)  N N+a-1  N-1 

That  is,  Tjj,  the  mean  of  the  modified  Savage  statistic  when  N 

frequencies  are  ranked,  satisfies  the  recursion  relation 

T = i + CN-_1)  T . 

N N N+a-1  N-1 

It  is  easily  verified  that 

T = -i  + i ^ satisfies  this  relation,  or  that 

N N a r(N+a) 

p/c  In')  = i i where  a * — ^ • 

E(S|9)  - N ^ a r(N+a)  1+0 

Corollary  1 ! 

Since  E(S|9)  = -^  + ~ - where  a = and  r'(Z)  “ 4'(Z)r(Z) 

' N a "(N+a)  1+6 

where  ^(Z)  is  the  digamma  function  [?)  it  is  easily  verified  that 

1 (4'(N+1)  - M'd)) 

30  « 

9=0 


11 
= 1 - — I — 
N k 

k=l 


We  note  that  E(S|0)  = 1 or  the  mean  of  S under  the  null  hypothesis  is  one. 
Proposition  2;  The  variance  of  the  statistic  S under  the  null  hypothesis  is 


given  by 


2 11 

a^(S)  = 1 - z:  7 

0 ” j«l 


First  we  prove  E(S  ) 


11 
2 - — I — 

« J=l'' 


and  then  as  E(S|0)  = 1,  (S)  is  easily  found. 
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2 ^ ^12  1 
E(S  ) - I j>  N- 

k*! 

2 

We  show  E(S  ) defined  by  (4)  reduces  to  (3)  by  mathematical  Induction.  By 
direct  calculation  (4)  reduces  to  (3)  when  N Is  2.  Next  we  assume  the  result 
holds  for  N-1  and  prove  It  then  holds  for  N. 


Since 


\J=N-k'^/  \j=N-k  ^ / N^  ^ J=N-k 


for  any  k from  1 to  N-1  we  may  write 


k=l  \ J=N-k  ^ / k=l  \ J=N-k  ^ ^ J 

N / N \ 

^ ^ T 1 - 2 + ^ • 

k=l  \j=N-k+l  ^ J ” 


^ (N-1) 


That  Is, 


i w E iV-i  V Te' 

” k=l  \j=N-k+l  ^ ” k=l  \j=N-k  ^ ” N^ 


By  assumption 


""  ( 4 V - 

k=l  \j=N-k  / 


N-1 

2 (N-1)  - 11 

J=1  J 


and  hence 


" I LL  O'  ■ » - 3!  j]  ^ " ■ ? ■ ^ - 7 ii 

The  results  of  the  above  propositions  now  enable  us  to  evaluate 
the  efficiency  of  the  Savage  detector  using  Equatlon(2] • 
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1 1 


It  can  be  shown  (2)  that  the  efficiency  of  the  optimum  detector  is  unity. 


Thus  the  ARE  of  the  Savage  detector  with  respect  to  the  optimum 


is  given  by 


1 1 
F = 1 — •“  Z “ 

S,opt:  N J 


Sc  Detector 


Let  Sc  in  this  section  denote  the  Sc  random  variable  a(R^j)  = 


sign  (R^j-c).  The  mean  of  Sc  for  a given  signal-to-noise  ratio  is  then 


E(Sc|0)=  Z P(k,N,a  where  P(k,N,a)  is  given  by  Equation  (la), 
k=N-c+l 


It  then  follows  that 


9P(k.,N,e)  I ^ i (4>(N+1)  - 'l'(N+l-k)  - 1)  . 


Hence 


■i  E 

N ^ 
k=N-c+l 


(H-CN+l)  - VCN+l-k)  - 1) 


= ^ (cy(N+l)  - {cy(c)  - c + 1}  - c) 
N 


= ^ (>t'(w-i)  - yCc+i)) . 


Under  the  null  hypothesis  P(k,N,l)  = — for  all  k. 


Hence  E(Sc|0)  = c/N  and  E(Sc^|0)  » c/N  as  well.  Thus  the  variance  under  the 


null  hypothesis  is  given  by 


a^(Sc)  - f (1  - c/N). 


Substitution  of  the  above  quantities  in  Equation  (2)  gives  the 


efficiency  of  this  type  of  detector.  Thus 
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'sc  ■ 

N ^ N ^ 

- ^ (y(N+I)  - M'(c+1))^ 


Once  again  the  efficiency  of  the  optinjum  receiver  is  unity.  Thus 
the  ARE  of  the  Sc  detector  is 


E 


Sc, opt 


(5b) 


The  ARE  of  the  detector  when  c = 1 has  been  determined  by  Hansen 
and  Olsen  (2)  and  agrees  with  this  formula. 

Table  I below  tabulates  for  various  values  of  N the  c which  cor- 
responds to  the  detector  with  maximum  ARE.  As  N tends  to  infinity  the  c 
corresponding  to  the  maximum  ARE  is  given  by  c = .2032  N with  an  ARE  of 


.6476. 


ASYMPTOTIC  RELATIVE  EFFICIENCY  FOR 
FLUCTUATING  AND  SINUSOIDAL  SIGNALS 

It  is  easily  verified  that  I 


0=0 


is  the  same  for  all  forms  of  P(k,N,6)  given  in  Equations  (1®)  (lb)  and  (Ic) 


Thus  E(W|0) 


0=0 


is  the  same  for  all  signals.  Also  we  have  the  identical  null  hypothesis 
for  all  types  of  signals.  Hence  the  ARE's  for  the  gaussian,  sinusoidal  and 
fluctuating  signals  are  equal. 


UNCLASSIFIED 
UNLIMITED  DISTRIBUTION 


- 9 - 


COMPARISON  OF  ASYMPTOTIC  RELATIVE  EFFICIENCIES 
In  (2)  it  is  shown  that  the  ARE  of  the  Mann-Whitney  detector  [8)  is 
^ j-  and  that  of  the  modified  Mann-Whitney  is 

1+1(N-1)~  J 

^ ^ I • Table  I gives  the  ARE  of  these  detectors,  the 

1+2 (N-l)""^  J 

modified  Savage  detector,  the  SI  detector  and  the  Sc  detector  member  with 
maximum  ARE. 


given  by 


TABLE  I.  Asymptotic  relative  efficiency  of  various  nonparametric  detectors 
as  compared  to  the  optimum  parametric  detector. 


N 

Modified 

Savage 

Mann- 

Whitney 

Modified 

Mann- 

Whitney 

Maximum 
of  Sc 
and 

corresponding  c 

SI 

1 

.250 

.375 

.250 

.250 

(1) 

.250 

1 

.388 

.500 

.375 

.347 

(1) 

.347 

.479 

.563 

.450 

.391 

(1) 

.391 

1 

.630 

.643 

.563 

.478 

(2) 

.423 

8 

.660 

.656 

.583 

.494 

(2) 

.422 

16 

.789 

.703 

.662 

.561 

(4) 

.378 

32 

.873 

.727 

.705 

.602 

(7) 

.302 

64 

.926 

.738 

.727 

.624 

(14) 

.223 

CD 

1 

.75 

.75 

.6476  (c? 

.2N) 

0 

We  note  that  the  Mann-Whitney  has  the  highest  ARE  if  N is  seven  or 
less.  However,  for  larger  values  of  N the  modified  Savage  is  best.  The 
number  of  estimates  that  must  be  ranked  simultaneously  to  calculate  the  Mann- 
Whitney  statistic,  namely  MN,  makes  this  scheme  unattractive  in  many  practical 
For  all  values  of  N the  modified  Savage  ARE  is  as  good  as  or  better 


problems . 
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I 


than  the  modified  Mann-Whltney  ARE  with  equality  only  when  N Is  two. 

The  most  Important  result  is  that  as  N tends  to  infinity  the  ARE 
of  the  modified  Savage  statistic  tends  to  one  while  the  ARE  of  both  the  Mann- 
Whltney  tests  approaches  3/4* 

Table  II  is  a tabulation  of  the  asymptotic  loss  In  decibels 
(compared  to  the  optimum  parametric  detector)  for  the  modified  Savage  and 
Mann-Whltney  statistics.  We  note  that  if  N is  eight  or  more  this  loss  is 
less  than  1 dB  for  the  modified  Savage  detector. 

TABLE  II.  Asymptotic  loss  of  the  modified  Savage  and  Mann-Whitney  detectors 
compared  to  the  optimum  parametric  detector  (in  decibels). 


N 

Modified 

Savage 

Mann- 

Whitney 

2 

3.0 

3.0 

4 

1.60 

1.25 

8 

.90 

.92 

16 

.52 

.77 

32 

.30 

.69 

64 

.17 

.66 

00 

0 

.63 

I 


] 

i 


A 


1 
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CONCLUSIONS 

The  asymptotic  performance  for  the  modified  Savage  detector  and  Sc 
class  of  detectors  has  been  obtained.  Comparison  by  way  of  ARE  of  these  detec- 
tors with  other  detectors  commonly  used  is  given  in  Table  I. 

The  ARE  of  the  Savage  detector  approaches  1 as  N,  the  number  cf 
spectral  estimates  ranked,  increases.  We  note  that  if  N is  seven  or  more  the 
ARE  of  the  modified  Savage  detector  is  higher  than  that  of  the  Mann-Whltney, 
"usually  considered  to  be  one  of  the  more  effective  non-parametric  tests  for 
use  in  two-sample  detection  situations"  (2) . 

Table  II  shows  that  for  values  of  N that  might  be  used  in  a practi- 
cal implementation  (say  N « 8,  16,  32,  64)  the  asymptotic  loss  of  the  modified 
Savage  detector  with  respect  to  the  optimum  parametric  detector  is  less  than 
1 dB  (.90,  .52,  .30,  .17  decibels  respectively). 
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